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IMAGE GENERATION METHOD, PROGRAM, AND 
INFORMATION STORAGE MEDIUM 

Japanese Patent Application No. 2003-94489, filed on March 31, 2003, is 
5 hereby incorporated by reference in its entirety. 

BACKGROUND OF THE INVENTION 
The present invention relates to an image generation method, program and 
information storage medium. 
10 In the prior art, an image generating system (or game system) for generating an 

image visible from a virtual camera (or a given viewpoint) in an object space which is a 
virtual three-dimensional space is known. It is highly popular as a method by which a 
so-called virtual reality can be experienced. In such an image generating system, it is 
desired that even plants including trees can realistically be represented (see Japanese 
15 Patent Application Laid-Open No. 2002-24858). 

However, a conventional L system required a complicated process to generate 
images of trees (which, in a broad sense are plants). 

A technique of representing a tree by fixedly arranging dome-shaped branch 
part objects around the trunk part object in all directions may be conceived. However, 
20 so many branch part objects are generated with such a technique that substantial storage 
capacity of a memory is required. 

Another technique of representing a tree by mapping image textures of the tree 
on a flat plate-shaped polygon, which is known as "billboard" technique may also be 
conceived. In such a "billboard" technique, however, if the hidden surface removal is 
25 carried out by Z buffer, the moment when a flat plate-shaped polygon is positionally 
replaced by another flat plate-shaped polygon will be noticeable. This will degrade the 
generated image. 
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BRIEF SUMMARY OF THE INVENTION 
According to one aspect of the present invention, there is provided an image 
generation method for generating an image comprising: 

storing object data in an object data storage section; 
5 disposing a plurality of objects in an object space, based on the object data 

stored in the object data storage section; 

controlling a virtual camera; and 

generating an image viewed from the virtual camera in the object space while 
performing hidden surface removal processing, 
10 the method further comprising: 

disposing in the object space a model object including a plurality of part 
objects each of which has a projection shape, each of the part objects having a 
projecting portion formed on a display surface on which an image is drawn; and 

rotating each of the part objects based on rotational information of the virtual 
15 camera so that the display surface of each of the part objects is directed toward the 
virtual camera. 

According to another aspect of the present invention, there is provided an 
image generation method for generating an image comprising: 

storing object data in an object data storage section; 
20 disposing a plurality of objects in an object space, based on the object data 

stored in the object data storage section; 

storing a Z texture in which an offset value of a Z-value is set on each texel in a 
texture storage section; 

mapping the Z texture stored in the texture storage section on each of the 

25 objects; 

controlling a virtual camera; and 

generating an image viewed from the virtual camera in the object space while 
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performing hidden surface removal processing, 
the method further comprising: 

disposing a model object having a plurality of part objects in the object space; 

rotating each of the part objects based on rotational information of the virtual 
5 camera so that a display surface of each of the part objects on which an image is drawn 
is directed toward the virtual camera; and 

mapping on each of the part objects the Z texture for forming a virtual 
projection shape on the display surface of the part objects. 

1 0 BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

FIG. 1 is a functional block diagram of an image generating system according 
to an embodiment of the present invention. 

FIGs. 2A and 2B illustrate a technique using a flat plate-shaped polygon. 
FIGs. 3 A, 3B and 3C show examples of part objects. 
15 FIGs. 4A and 4B illustrate a technique using projection-shaped part objects in 

accordance with an embodiment of the present invention. 

FIGs. 5 A and 5B illustrate rotational processing about the Y-axis. 
FIGs. 6A and 6B show examples of images generated when a virtual camera 
rotates about the Y-axis. 
20 FIGs. 7A and 7B show examples of images generated when the virtual camera 

rotates about the Y-axis. 

FIGs. 8 A and 8B illustrate rotational processing about the X-axis. 
FIGs. 9A and 9B show examples of images generated when the virtual camera 
rotates about the X-axis. 
25 FIGs. 10A and 10B show examples of other images generated when the virtual 

camera rotates about the X-axis. 

FIGs. 1 1 A and 1 IB show examples of images of model objects each configured 
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by a number of part objects. 

FIGs. 12A and 12B show examples of images of model objects each configured 
by a number of part objects. 

FIG. 1 3 shows a texture-mapped image. 
5 FIG. 14 illustrates an arrangement of part objects. 

FIGs. 15 A, 15B and 15C illustrate a Z-texture-mapping. 

FIGs. 16A, 16B and 16C illustrate a technique of using the Z-texture mapping 
to represent the whole projection shape or fine bump shapes. 

FIG. 17 is a flow chart illustrating an example of a process according to an 
10 embodiment of the present invention. 

FIG. 18 is an example of object data structure. 

FIG. 19 is an example of a hardware configuration. 

FIGs. 20A, 20B and 20C show examples of systems in various forms. 

1 5 DETAILED DESCRIPTION OF THE EMBODIMENT 

Embodiments are described below. 

Note that the embodiments described below do not limit the scope of the 
invention defined by the claims laid out herein. Similarly, the overall configuration of 
the embodiments below should not be taken as limiting the subject matter defined by 
20 the claims herein. 

1 . Configuration 

FIG. 1 shows a functional block diagram of an image generating system (or 
game system) according to this embodiment. However, the image generating system is 
25 not necessarily required to include all the components (or sections) shown in FIG. 1 , but 
may be configured to omit at least one section (e.g., a control section 160, a portable 
information storage device 194 or a communication section 196). 
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The control section 160 is used for a player to input operation data, and its 
function can be realized by any one of various hardware pieces such as a lever, a button, 
a steering wheel, a shift lever, an accelerator pedal, a brake pedal, a microphone, a 
sensor, a touch panel type display and a housing. 
5 A storage section 1 70 provides a work area for the processing section 1 00 and a 

communication section 196, and its function being able to be realized by hardware such 
as RAM. 

An information storage medium 180 (or a computer-readable medium) is to 
store a program or data, and its function can be realized by hardware such as an optical 

10 disc (CD or DVD), a magnetic optical disc (MO), a magnetic disc, a hard disc, a 
magnetic tape or a memory (ROM). A processing section 100 is designed to perform 
various kinds of processes according to this embodiment, based on programs (or data) 
which have been stored in this information storage medium 180. In other words, the 
information storage medium 180 has stored (or recorded) a program for causing a 

15 computer to function various sections according to this embodiment or a program for 
causing a computer to execute the processing in each of the sections. 

A display section 190 is to output an image generated according to this 
embodiment, and its function can be realized by hardware, for example, CRT, LCD, a 
touch panel type display, HMD (head mount display) or the like. 

20 A sound output section 192 is to output a sound generated according to this 

embodiment, and its function can be realized by hardware, for example, a loud speaker, 
a headphone or the like. 

A portable information storage device 194 is designed to store a player's 
personal data or to save data relating to a game and may be of any form such as a 

25 memory card or a portable game device. 

The communication section 196 is designed to perform various controls for 
communicating the present image generating system to any other system (e.g., a host 
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device or other image generating systems), and its function can be realized by hardware, 
for example, various processors or communicating ASIC or any suitable control 
program. 

The program (or data) for causing the computer to function as the respective 
5 sections (or means) according to this embodiment may be distributed from the 
information storage medium possessed by the host device (or server) through a network 
and the communication section 196 into the information storage medium 180 (or 
storage section 170). Use of the information storage medium in such a host device (or 
server) may be also included within the scope of the present invention. 

10 The processing section (or processor) 100 is designed to perform various 

processing for game, image generation or sound generation, based on the operation data 
and programs from the control section 160. The game processes executed by the 
processing section 100 may include a process of starting the game only when a game 
start condition (selection of a course, a map, a character, or number of players, or the 

15 like) is satisfied, a process of advancing the game, a process of arranging various 
objects including the selected character and map in place, a process of displaying the 
objects, a process of computing the game results and a process of finishing the game 
only when a game termination condition is satisfied or other processes. The processing 
section 100 performs various processes by using the storage section 170 as a work 

20 region. The functions of this processing section 100 can be realized by hardware such as 
various processors (CPU, DSP and the like) or ASIC (gate array or the like) or a 
program (or game program). 

The processing section 100 comprises an object space setting section 110, a 
virtual camera control section 112, an image generating section 120 and a sound 

25 generating section 130. However, at least one of these sections may be omitted. 

The object space setting section 110 arranges and sets, in an object space, 
various objects representing characters, trees, cars, columns, walls, buildings, maps 
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(landforms) and others to be displayed (i.e., objects each of which is configured by 
polygons, free-form surfaces or primitive faces such as sub-division surfaces). That is to 
say, the object space setting section 110 determines the position and rotation angle (or 
orientation or direction) of an object in the world coordinate, and arranges that object at 
5 that position (on X-, Y- or Z-axis) with that rotation angle (about X-, Y-or Z-axis). 

More particularly, the object space setting section 110 reads object data 
including object positions, object rotation angles, object types (or object numbers) and 
the like, from the object data storage section 172, and arranges a plurality of objects in 
the object space, based on the read object data. In this case, the arranging of objects is 

10 realized based on the object data (including positions and rotation angles) expressed by 
the local coordinate system, various matrices for coordinate transformation (world 
coordinate transformation, camera coordinate transformation or perspective 
transformation) such as a rotation matrix, a translation matrix, and the like. 

For example, the object data may be read out of the information storage 

15 medium 180 and loaded into the object data storage section 172 when the image 
generating system is powered on. Alternatively, the object data may be downloaded 
from the host device into the object data storage section 172 through the communication 
section 196 and Internet (which, in a broad sense, is a network). 

The object space setting section 110 also performs the movement/action 

20 computation of a moving object (e.g., a motorcar, an airplane or a character), for 
example, a movement/action simulation. That is to say, the object space setting section 
110 performs a process of causing the moving object to perform the movement and the 
action (motion or animation) in the object space, based on the operation data inputted by 
the player through the control section 160, a program (or movement/action algorithm), 

25 various data (motion data) and others. More particularly, the object space setting section 
110 performs a simulation for determining the movement information of the moving 
object (position, rotation angle, speed or acceleration) and the action information 
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(position or rotation angle of each part object) sequentially, for example, for each frame 
(each 1/60 second). 

The virtual camera control section 112 controls a virtual camera for generating 
an image in the object space as viewed from a given (or any) viewpoint therein. That is 
to say, the virtual camera control section 112 performs a process of controlling the 
position (on X-, Y- or Z-axis) or rotation angle (about X-, Y- or Z-axis) of the virtual 
camera (or a process of controlling the position or direction of the viewpoint in the 
virtual camera). 

For example, if a moving object is to be taken from the rear thereof by the 
virtual camera, the position or rotation angle (or direction) of the virtual camera is 
controlled so that it follows the changed position or rotation of the moving body. In this 
case, the virtual camera can be controlled based on information for the position, rotation 
angle or speed of the moving body which has been obtained by the object space setting 
section 110 (or movement/action computing section). Alternatively, the virtual camera 
may be rotated through a predetermined angle while being moved along a 
predetermined path of movement. In such a case, the virtual camera is controlled based 
on virtual camera data used to specify the position (path of movement) and rotation 
angle of the virtual camera. 

The image generating section 120 generates an image based on the results of 
various processes (game processing) performed in the image processing section 1 00, the 
generated image being then outputted toward the display section 190. That is to say, if a 
so-called three-dimensional game image is to be generated, the coordinate 
transformation (world coordinate transformation or camera coordinate transformation), 
clipping processing, perspective transformation or geometry-processing such as 
light-source computation will first be performed, the processing results being then used 
to create drawing data (positional coordinates of a vertex in a primitive face, texture 
coordinates, color data, normal vector or alpha-value). And, based on this drawing data 
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(or primitive face data), the image of the perspective-transformed (or 
geometry-processed) object (which may consist of one or more primitive faces) is then 
drawn in a drawing buffer 174 (which may be a frame or work buffer for storing the 
image information by pixel unit). Thus, an image may be generated in the object space 
5 as viewed from the virtual camera (or a predetermined viewpoint). 

The image generating section 120 includes a hidden surface removal section 
122. The hidden surface removal section 122 uses a Z buffer (depth buffer) 176 which 
has stored Z-values (or depth information) so as to perform the hidden surface removal 
through a Z-buffer method (or depth comparison method). 

10 The image generating section 120 also includes a texture mapping section 124. 

The texture mapping section 124 is to map a texture (or texture data) stored in a texture 
storage section 178 onto an object (primitive face). More particularly, the texture 
mapping section 124 uses texture coordinates or the like set (or given) to each of the 
vertexes of the object (primitive face) to read a texture (or a surface property such as 

15 color, luminance, normal line, Z-value, alpha-value or the like) out of the texture storage 
section 178. The texture mapping section 124 then maps (or projects) the texture 
consisting of a two-dimensional image or pattern onto the object. In this case, a process 
of associating texels with pixels or a bi-linear interpolation (or texel interpolation) is 
carried out therein. Moreover, the texture mapping may be carried out using a lookup 

20 table (LUT) for index color texture mapping. 

The sound generating section 130 performs sound processing based on the 
results of various processing at the processing section 100 to generate game sounds such 
as BGMs, effect sounds or voices, which are in turn outputted toward the sound output 
section 192. 

25 In this embodiment, the object space setting section 110 arranges a model 

object (which, in a narrow sense, is a tree object or plant object) formed by part objects 
(which, in a narrow sense, are branch objects) in the object space. In other words, the 
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model object is set in the object space based on the object data. These part objects are 
then rotated with their display surfaces (on each of which an image is to be drawn or a 
texture is to be mapped) being directed toward the virtual camera. This rotation may be 
carried out based on the rotational information (rotation angle and direction) for the 
5 virtual camera. Moreover, each of the part objects is a projection-shape(convex)-object 
(cone-shaped, pyramid-shaped, or umbrella-shaped object) having a projecting (convex) 
portion (vertex or ridgeline) formed on the side of the display surface on which the 
image is to be drawn. 

More particularly, the object space setting section (or rotation control section) 

10 110 rotates the part objects in the model object about their coordinate axes as the virtual 
camera rotates about a given coordinate axis. Further particularly, the object space 
setting section 110 rotates the part objects about Y-axis (vertical coordinate axis or first 
coordinate axis in the world coordinate system), based on the rotation angle of the 
virtual camera about the Y-axis. Moreover, the object space setting section 110 also 

15 rotates the part objects about X-axis (coordinate axis perpendicular to the Y-axis, or 
second coordinate axis), based on the rotation angle of the virtual camera about the 
X-axis. 

In this embodiment, a Z texture (Z texture data) in which offset Z-values 
(changed values or corrected values) have been set (or stored) is stored in the texture 
20 storage section 178. The texture mapping section 124 then reads this Z texture and maps 
it onto the object. 

More particularly, a Z texture used to set bump shapes (which are finer than the 
projection-shape of the entire part object) on the display surface of a part object by pixel 
(which is smaller than primitive face unit) is stored in the texture storage section 178. 
25 The texture mapping section 124 reads this Z texture, and maps it on each of the part 
objects forming the model object. Alternatively, a Z texture used to form a virtual 
projection shape (which is obtained by adding or subtracting offset Z-values to or from 
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the original Z-values in a part object) on the side of the display surface in a flat 

plate-shaped part object is stored in the texture storage section 178. The texture 

mapping section 124 then reads this Z texture and maps it on each of the part objects. 

Alternatively, the Z textures used to form a virtual projecting portion on a part object 
5 and to set bump shapes on the display surface of the part object by pixel may be read 

out and mapped on each of the part objects. Thus, any blink at an intersection between 

adjacent part objects will not be noticeable. 

The image generating system of this embodiment may be dedicated for a 

single-player mode in which only a single player can play a game or may have a 
10 multi-player mode in which a plurality of players can play a game simultaneously, in 

addition to such a single-player mode. 

If a plurality of players play the game, a single terminal may be used to 

generate game images and game sounds to be provided to these plural players. 

Alternatively, these game images and sounds may be generated through a plurality of 
15 terminals (game machines or cellular phones) which are interconnected through a 

network (or transmission line, telecommunication line). 

2. Techniques according to this embodiment 

The techniques in this embodiment will now be described with reference to the 

20 drawing. 

2.1 . Representation of tree by projection-shaped part objects 

One of the techniques of representing trees (or plants) is conceivable to be a 
technique as referred to as billboard. In such a technique, as shown in figure 2A, a 
25 texture of tree image is mapped on fiat plate-shaped polygons PL1 and PL2 which are 
always faced directly to the front of the virtual camera VC. 

In this technique, however, if the position and rotation angle (or direction) of 
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the virtual camera VC are changed as shown by Al to A2 in Fig. 2A 5 the moment at 
which the positional relationship between the polygons PL1 and PL2 is inverted will be 
noticeable, as shown by A3 and A4 in Fig. 2B. That is to say, the Z-buffer method 
performs the hidden surface removal based on the Z-values (or depth values). And, at 
5 Al of FIG. 2A, the Z-values of PL1 and PL2 indicate that PL1 is located forward of PL2 
whereas at A2, the Z-values of PL1 and PL2 indicate that PL2 is located forward of PL1. 
Thus, such an instantaneous inversion as shown by A3 and A4 in FIG. 2B will be 
noticeable. Thus, a player will notice that a tree is represented by plate-shaped polygons 
PL1 and PL2. This raises a problem in that a high-quality image could not be generated. 
10 In this embodiment, thus, such a problem is overcome by representing a branch 

of a tree (or model object) by use of such an umbrella-shaped part object POB as shown 

in FIG. 3A. That is to say, a branch object is represented by use of a part object POB of 

•» 

projection shape that has a projecting portion PV formed on the side of the display 
surface on which an image is to be drawn (or a texture is to be mapped). More 

15 particularly, the branch is represented by a centrally raised conical or pyramid-shaped 
part object POB (but the bottom of the cone or pyramid being removed). Such a POB is 
formed by a plurality of primitive faces (triangular polygons) sharing a vertex (or 
projecting portion PV). 

As shown by Bl, B2 and B3 of FIG 4 A, the part objects (braches) POB1 and 

20 POB2 forming a model object (tree) MOB are rotated so that the display surfaces on 
which images are to be drawn (or the side of projecting portions PV1 and PV2) are 
always directed toward the virtual camera VC or so that an imaginary bottom face of 
each cone or pyramid is directed directly to the face of the virtual camera VC. 

Thus, as shown by B4 in FIG 4B, the hidden surface removal in the Z-buffer 

25 method can effectively be utilized so that the positional relationship between the 
adjacent part objects POB1 and POB2 will smoothly be inverted, since they merge into 
each other even though they overlap. 
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That is to say, at A3 and A4 in FIG 2B, the positional relationship between PL1 
and PL 2 is instantaneously inverted. However, in FIG. 4B, the positional relationship 
between POB1 and POB2 is gradually inverted while gradually changing the shape of 
an intersection boundary line shown at B4. Thus, the player will not notice that the tree 
5 branch is represented by simple part objects POB1 and POB2. As a result, a 
high-quality image can be generated with smaller amount of data. 

For example, as a technique different from that of this embodiment, it is also 
conceivable to take a technique of fixedly arranging such a part object POB as shown in 
FIG 3A in all directions without depending on the position of the virtual camera VC. In 
10 such a technique, however, the number of polygons in the model object representing the 
tree will increase since it is necessary to arrange a plurality of part objects POB having 
such a shape as shown in FIG. 3 A around the tree trunk in all directions. 

On the contrary, according to the technique of this embodiment, it will not be 
required that the branch part objects are arranged around the tree trunk in all directions 
15 since the branch part object is rotated so that the display surface thereof is directed 
toward the virtual camera VC as shown in FIG. 4A. Thus, a high-quality image which 
could not be realized by such a technique as described in connection with FIGs. 2A and 
2B can be generated while minimizing the number of polygons (primitive faces) in the 
model object. 

20 The shape of the part object POB is not limited to such a shape as shown in FIG. 

3A. For example, the shape of the part object POB may be of cone shape rather than 
such a pyramid shape as shown in FIG 3A. Moreover, the shape of the part object POB 
may have a plurality of projecting portions or vertexes as shown in FIG 3B. 
Alternatively, the shape of the part object POB may be of mountain-like angled shape 

25 having ridgelines as projecting portions as shown in FIG 3C. 

2.2. Rotation 
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Next, the concrete rotation of part object will be described. In this embodiment, 
as shown in FIG. 5 A, the model object MOB representing a tree comprises a part object 
POB representing a branch and a column-shaped or substantially column-shaped part 
object COB representing a trunk. 
5 The column-shaped part object COB is disposed in the object space to stand 

along the vertical Y-axis. The part object POB is also arranged at a position spaced apart 
from the central axis CA of the column-shaped part object COB. More particularly, the 
part object POB is disposed at a position spaced apart from the central axis CA and also 
in which it will not overlap the part object COB. 

10 As shown in FIGs. 5 A and 5B, the object space setting section 110 rotates the 

part object POB about the Y-axis so that the display surface (or projecting portion PV) 
thereof will be directed toward the virtual camera VC as the virtual camera VC rotates 
about the Y-axis (or panned about the central axis CA) while being directed toward the 
column-shaped part object COB (POB). That is to say, the part object POB is rotated 

15 about the central axis CA following the rotation of the virtual camera VC. For example, 
if the virtual camera VC rotates about the Y-axis by a rotation angle 0Y, the part object 
POB is also rotated about the Y-axis by the rotation angle 9Y. On the other hand, the 
column-shaped part object COB representing the trunk will not be rotated. 

For example, if the positional relationship between the model object MOB 

20 formed by the part objects POB1, POB2 and COB and the virtual camera VC is as 
shown in FIG. 6A, such an image (view image) as shown in FIG. 6B will be generated. 
And, if the virtual camera VC rotates from the position of FIG. 6A about the Y-axis or 
panned while being directed toward the model object MOB, as shown in FIG. 7A, such 
an image as shown in FIG. 7B will be generated. 

25 That is to say, according to this embodiment, it can provide an improved 

three-dimensional picture in which the part objects POB1 and POB2 can be viewed as if 
each is a three-dimensional object without opening since the display surfaces (or 
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projecting portions) of the part objects POB1 and POB2 are always directed toward the 
virtual camera VC. Moreover, even if the virtual camera VC rotates 360 degrees around 
MOB while being directed toward MOB (or even if the VC rotates 360 degrees about a 
given coordinate axis), the part objects POB1 and POB2 are located just before the 
5 column-shaped part object COB representing the trunk to hide the COB. Therefore, only 
two part objects POB1, POB2 can be used to provide a picture in which the branches 
(POB 1, POB 2) can be viewed as if they extend around the trunk (COB) in all 
directions. As a result, a more realistic and natural image can be generated by use of less 
primitive faces. 

10 As shown in FIGs. 8A and 8B, the part object POB is rotated about the X-axis 

so that the display surface (or projecting portion PV)will be directed toward the virtual 
camera VC as the virtual camera VC rotates about the X-axis (which is perpendicular to 
the Y-axis) while being directed toward the column-shaped part object COB(POB). That 
is to say, if the virtual camera VC rotates about the X-axis by a rotation angle 0X, the 

15 part object POB is also rotated about the X-axis by the rotation angle 0X. 

For example, if the virtual camera VC rotates about the X-axis to change the 
relationship between the VC and the model object MOB shown in Fig. 6A to such a 
positional relationship as shown in Fig. 9A (or a positional relationship in which the 
virtual camera VC looks down at MOB with a predetermined angle of elevation), such 

20 an image as shown in FIG. 9B will be generated. Moreover, if the virtual camera VC is 
further rotated about the X-axis to change the relationship between the VC and the 
model object MOB to such a positional relationship as shown in Fig. 10A (or a 
positional relationship in which the virtual camera VC looks down at MOB from just 
above), such an image as shown in FIG. 10B will be generated. 

25 In such a manner, according to this embodiment, even if the virtual camera VC 

is not only rotated about the Y-axis but also about the X-axis (that is, even when the 
virtual camera VC looks down at the model object MOB from above), the display 
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surfaces of the part objects POB1 and POB2 will always be directed toward the virtual 
camera VC. And, the object parts POB1 and POB2 will hide the column-shaped part 
object COB representing the trunk. Therefore, this embodiment can represent the 
branches as if they are three dimensional objects without opening and also generate a 
5 realistic image in which the branches can be viewed as if they extend around the trunk 
in all directions. Moreover, for example, in an airplane game wherein a moving object 
(airplane or the like) flies over a tree looking down at the ground, a more natural and 
consistent image can be generated. 

Furthermore, according to this embodiment, the positional relationship between 

10 the part objects POB1 and POB2 (or the positional relationship therebetween in the 
direction of depth in the camera coordinate system) can smoothly be inverted by 
effectively using the hidden surface removal function of the Z-buffer method, as shown 
by CI in Fig. 9B and by Dl in FIG. 10B. Therefore, an image in which a player does not 
feel unnaturalness can be generated. 

1 5 The number of part objects representing branches is not limited to two, but may 

be increased to three or more. Alternatively, only a single part object may be used. For 
example, Figs. 11 A, 11B, 12A and 12B illustrate model objects MOB each of which 
comprises a number (e.g., ten) of part objects. When the number of part objects 
increases in such a manner, the number of primitive faces also increases. However, it 

20 may generate an improved three-dimensional image of tree. 

FIG. 13 illustrates a final image which is obtained by mapping a tree texture on 
part objects. In this case, it is desirable that the mapped texture is one that can set an 
alpha- value (transparency or translucency) on each of the texels. 

25 2.3. Spacing between arranged part objects 

It is desirable that the spacing between adjacent part objects (branches) forming 
a model object (tree) is set as follows. For example, FIG. 14 shows adjacent part objects 
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POB1, POB2 (first and second part objects) included in a model object MOB. 

Even if the virtual camera VC rotates 360 degrees about a given coordinate 
axis (Y-axis, X-axis or the like), as shown at El to E8 in FIG 14, the part objects POB1, 
POB2 intersect each other or the part objects POB1, POB2 are arranged with such a 
5 spacing that they overlap each other in a view image viewed from the virtual camera 
VC. Such a spacing may be realized, for example, by arranging the part objects POB1, 
POB2 so that, if it is assumed that the length of a generating line extending from one 
projecting portion (vertex) PV1 in the part object POB1 to the peripheral edge of the 
same (see El in FIG. 14), the projecting portion PV2 of the object part POB2 is 
10 positioned within a circle having a radius L (or twice L) measured from the projecting 
portion PV1. 

For example, at E2 and E6 in FIG 14, the adjacent part objects POB1, POB2 
intersect each other. That is to say, there is created such an intersection boarder line as 
shown at CI in FIG 9B. On the other hand, at El, E3, E4, E5, E7 and E8 in FIG 14, the 

15 part objects POB1, POB2 overlap each other in the view image viewed from the virtual 
camera VC. That is to say, as shown at Dl in FIG 10B, the part objects POB1, POB2 
are arranged so that the part object POB1 is located forward of the other part object 
POB2 in the depth direction. And, the part objects POB1, POB2 overlap each other in 
the view image of the virtual camera VC shown in FIG 10B. 

20 If the part objects POB1, POB2 are arranged in such a manner, there will not be 

created a clearance between the part objects POB1, POB2 as viewed by the virtual 
camera VC. Therefore, the column-shaped part object COB representing the trunk of the 
tree can be hidden by the part objects POB1, POB2. Thus, a more natural and realistic 
image can be generated. 

25 Although the two part objects (branches) are shown in FIG. 14, three or more 

part objects may be used under the same concept. 
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2.4. Z texture 

In this embodiment, the virtual shape of a part object POB may be represented 
by mapping a Z texture in which an offset Z-value (changed Z-value or corrected 
Z-value) is set to each texel onto the part object POB. 
5 FIG. 15A illustrates the principle of Z-texture-mapping technique. In FIG. 15 A, 

an object OB (which is, in a narrow sense, a polygon: The same shall apply hereinafter) 
has vertexes, on each of which texture coordinates (U, V) used to read the Z texture are 
set. 

According to the conventional texture mapping, a colored "pattern" stored in 
10 the texture storage section 178 of FIG. 1 will be applied to the object OB when it is to be 
drawn. On the contrary, the Z-texture-mapping causes offset Z-values to be subjected to 
addition (or subtraction) so that a "pattern" of Z-value is applied to the region of the Z 
buffer 176 corresponding to the object OB. 

For example, at Fl in FIG. 15A, a Z-value corresponding to the object OB 
15 (which is shown by "1" in FIG. 15 A) is written into the Z buffer 176 by drawing the 
object OB into drawing buffer 174. 

On the other hand, as shown at F2 in FIG. 15 A, an offset Z-value is set on each 
of the texels in the texture storage section 178 (Z-texture space). The offset Z-value is 
then read out of the texture storage section 1 78, based on the texture coordinate (U, V) 
20 set on each vertex in the object OB. 

The offset Z-value read out at F2 is then added to or subtracted from the 
Z-value (or original Z-value in the object OB) in the Z buffer 176 shown at Fl, as 
shown at F3. Thus, as shown at F4, a new Z-value (Z-plane) will be generated by 
adding or subtracting the offset Z-value to or from the original Z-value in the object OB. 
25 The hidden surface removal process (positional -relationship judgment process based the 
Z-value) is then carried out on the object OB (polygon), based on the new Z-value 
obtained by the addition or subtraction of the offset Z-value at F4. 
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For example, if the Z-texture-mapping is not used, the intersection boundary 
line between the part objects POB1, POB2 becomes a straight line as shown at F5. On 
the contrary, if the Z-texture-mapping is used, the intersection boundary line between 
POB1 and POB2 can delicately be waved as shown at F6 in FIG. 15C. In this 
5 embodiment, this Z-texture-mapping technique is used to represent the fine bump 
shapes of the part object or to represent the entire projection shape of the part object 
itself. 

For example, FIG 16A shows a projection-shape-object having a projecting 
portion formed on the display surface in which an image is to be drawn, this object 

10 being used as a part object POB. The Z texture for setting the bump shapes on the 
display surface of POB by pixel is then mapped on this projection-shaped part object 
POB. Thus, virtual bump shapes VZS are set on the part object POB. That is to say, 
virtual Z-values for providing bump shapes in the direction of sight line by pixel are set 
in that region of the Z buffer 176 corresponding to the part object POB. 

15 The hidden surface removal process on the part object POB (or the hidden 

surface removal process between the part object POB and the other part object) is then 
carried out, based on this virtual Z-value (shape VZS). Therefore, the intersection 
boundary line between POB1, POB2 can more delicately be waved as shown at CI in 
FIG 9B. As a result, even if the position or rotation angle of the virtual camera VC is 

20 changed, the positional relationship between POB1, POB2 can delicately be inverted by 
pixel. Consequently, a more natural and realistic image can be generated. 

In addition, a flat plate-shaped object (polygon) may be used as a part object 
POB, and a Z texture used for forming a virtual projection shape VZS (which is similar 
to the projection shape in POB shown in FIG. 1 6 A) on the display surface of the POB 

25 may be mapped on the POB, as shown in FIG. 16B. Thus, a simply shaped part can be 
used as the part object POB, resulting in further decrease of the number of primitive 
faces. 
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Moreover, a Z texture used to set fine bump shapes by pixel in addition to a 
relatively large projection shape may be mapped on the flat plate-shaped part object 
POB, as shown in figure 16C. Thus, a more realistic image can be generated with less 
primitive faces. 

5 The technique of FIG 16A uses more primitive faces than those of the 

techniques shown in FIGs. 16B and 16C. In the shading process using a light source, 
however, a realistically shaded image can be generated since the projection shape of the 
part object POB can be reflected. If a normal-line texture in which the normal-line 
information is set on each texel is used, however, the techniques of FIGs. 16B and 16C 
10 can also perform the realistic representation for shading. 

3. Processing of this embodiment 

The details of a process according to this embodiment will be described in 
connection with a flow chart of FIG 17. 

1 5 First of all, the position (CX, C Y, CZ) of the virtual camera VC and the rotation 

angles (0X, 6Y, 9Z) thereof about the respective coordinate axes are set (step SI). For 
example, if the virtual camera VC follows a moving object such as airplane or motorcar, 
the position and rotation angle of the virtual camera VC can be set based on the position 
and rotation angle of the moving object. Moreover, if the virtual camera VC moves over 

20 a predetermined orbit, the position and rotation angle of the virtual camera can be set 
based on the virtual camera data. 

Next, a variable i is set to 1 (step S2). Object data for the i-th branch part object 
POBi are then read out, and the rotation angle of the POBi is transformed into the world 
coordinate system so that the POBi is directed toward the virtual camera VC, based on 

25 the rotation angles (8X 5 9Y, 0Z) of the VC (step S3). Thus, such a rotation of the part 
object as shown in FIGs. 5 A, 5B, 8A and 8B can be realized. FIG 18 shows an example 
of object data. This object data comprise positions Xi 3 Yi and Zi of each branch part 
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object POBi, rotation angles 0Xi, 0Yi, 0Zi thereof and object numbers thereof in the 
local coordinate system. 

The position of the branch part object POBi (or position included in the object 
data) is then transformed into the world coordinate system (step S4). The camera 
5 coordinate (viewpoint coordinate) transformation and perspective transformation are 
then carried out on the branch part object POBi. The branch part object POBi is then 
drawn in the drawing buffer while performing the hidden surface removal with the use 
of the Z buffer (step S5). The variable i is incremented by "1 " (step S6). 

Next, it is judged whether or not the variable i is larger than N (the number of 
10 branch part objects) (step S7). If i < N, the procedure returns to the step S3. On the other 
hand, if i > N, the world coordinate transformation, camera coordinate transformation 
and perspective transformation are carried out on the trunk (column- shaped) part object 
COB. The trunk part object COB is then drawn in the drawing buffer while performing 
the hidden surface removal with the use of the Z buffer (step S8). Thus, such view 
15 images as shown in FIGs. 6B, 7B and the like will be generated. 

Although FIG. 17 describes that the trunk part object is drawn after the branch 
part object has been drawn, the branch part object may be drawn after the trunk part 
object has been drawn. 

20 4. Hardware Configuration 

FIG. 19 illustrates a hardware configuration by which this embodiment can be 

realized. 

A main processor 900 operates to execute various processing such as game 
processing, image processing, sound processing and other processing according to a 
25 program stored in a CD (information storage medium) 982, a program transferred 
through a communication interface 990 or a program stored in a ROM 950. 

A co-processor 902 is to assist the processing of the main processor 900 and 
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has a sum of product circuit or a divider which can perform high-speed parallel 
calculation to execute a matrix (or vector) calculation at high speed. For example, if a 
physical simulation for causing an object to move or act (motion) requires the matrix 
calculation or the like, the program running on the main processor 900 instructs (or 
5 asks) that processing to the co-processor 902. 

A geometry processor 904 is to perform geometry processing such as 
coordinate transformation, perspective transformation, light source calculation, curve 
formation or the like and has a sum of product circuit or a divider which can perform 
high-speed parallel calculation to execute a matrix (or vector) calculation at high speed. 

10 For example, for the coordinate transformation, perspective transformation and light 
source calculation, the program running on the main processor 900 instructs that 
processing to the geometry processor 904. 

A data expanding processor 906 is to perform a process for decoding or 
expanding image and sound compressed data or a process for accelerating the decoding 

15 process in the main processor 900. Thus, animation images compressed by MPEG 
method or the like can be displayed in the opening, intermission, ending or game scene. 

A drawing processor 910 is to draw or render an object constructed by 
primitive faces such as polygons or curved surfaces at high speed. On drawing of an 
object, the main processor 900 uses the function of a DMA controller 970 to deliver 

20 the drawing data to the drawing processor 910 and at the same time, transfers the texture 
to a texture storage section 924, if necessary. Then, the drawing processor 9 1 0 draws the 
object in a frame buffer 922 while performing the hidden surface removal using the Z 
buffer and the like, based on the drawing data and texture. The drawing processor 910 
can also perform a-blending (or translucency processing), depth cueing, mip-mapping, 

25 fog processing, bi-linear filtering, tri-linear filtering, anti-aliasing, shading and the like. 
As the image for one frame has been written into the frame buffer 922, that image is 
then displayed on a display 912. 
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A sound processor 930 includes a multi-channel ADPCM sound source and the 
like and generates and outputs game sounds such as BGMs, sound effects, voices 
through a speaker 932. Operation data from a game controller 942 and save data from a 
memory card 944 and personal data are inputted through a serial interface 940. 
5 A ROM 950 has stored a system program and the like. In arcade game systems, 

a ROM 950 functions as an information storage medium for storing various programs. 
The ROM 950 may be replaced by any hard disk. A RAM 960 serves as working area 
for various processors. A DMA controller 970 controls DMA transfer between the 
processors and the memories (RAM, VRAM, ROM and the like). A CD drive 980 
10 works to access a CD 982 in which programs, image data or sound data have been 
stored. 

A communication interface 990 performs data transfer between the present 
system and an external through a network. The network connected to the 
communication interface 990 includes a telecommunication line (analog phone line or 

1 5 ISDN) and a high-speed serial bus. 

All the sections (means) of this embodiment may be executed only through 
hardware or only through a program which has been stored in an information storage 
medium or which is distributed through the communication interface. Alternatively, they 
may be executed through both the hardware and program. 

20 If the sections of this embodiment are to be realized through both the hardware 

and program, the information storage medium has stored a program for causing the 
hardware (or computer) to function as the respective sections in this embodiment. More 
particularly, the aforementioned program instructs the processing to the processors 902, 
904, 906, 910, 930, and the like, all of which are hardware, and delivers the data to them, 

25 if necessary. And, each of the processors 902, 904, 906, 910, 930, and the like will 
realize the processing of the corresponding one of the functional sections of the present 
invention, based on the instructions and delivered data. 
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FIG. 20A illustrates an arcade game system to which this embodiment is 
applied. Players enjoy a game by operating control sections 1102 while viewing a game 
scene displayed on a display 1100. Processors, memories and the like are mounted on a 
system board 1106 built in the game system. The program (data) for realizing all the 
5 sections of this embodiment has been stored in a memory 1108 which is an information 
storage medium on the system board 1106. This program is referred to as stored 
program. 

FIG. 20B illustrates a home game system to which this embodiment is applied. 
In this case, the aforementioned stored program (or stored information) have been 
10 stored in a CD 1206 which is a removable information storage medium on the main 
system body or in memory cards 1208, 1209. 

FIG. 20C illustrates a system to which this embodiment is applied, this system 
including a host device 1300 and terminals 1304-1 to 1304-n (gaming machines or 
cellular phones) which are connected to this host device 1300 through a network 1302. 
15 In this case, the aforementioned stored program has been stored in the information 
storage medium 1306 (hard disk, a magnetic tape device or the like) in the host device 
1300. Moreover, the processing for each section of this embodiment may be realized by 
the host device and terminals in a distributed manner. 

However, the present invention is not limited to the aforementioned 
20 embodiment, but may be carried out in any one of various other forms. 

For example, the terms (e.g., tree, branch, trunk, polygon, primitive face, plant, 
and the like) referred to in a passage of the specification or drawing as broader or 
synonymous terms (e.g., model object, part object, column-shaped part object, object, 
tree and so on) may be replaced by such broader or synonymous terms similarly in 
25 another passage of the specification or drawing. 

Part of requirements of a claim of the present invention could be omitted from 
a dependent claim which depends on that claim. Moreover, part of requirements of 
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any independent claim of the present invention could be made to depend on any other 
independent claim. 

Moreover, the rotation of part object is not limited to that described in 
connection with this embodiment, but may be carried out through any one of various 
5 other processes. 

The present invention can be applied to various games (such as fighting games, 
competition games, shooting games, robot fighting games, sports games, role playing 
games and the like). 

Moreover, the present invention can be applied to various image generating 
10 systems (or game systems) such as arcade game systems, home game systems, 
large-scale attraction system in which a number of players play a game, simulators, 
multimedia terminals, system boards for generating game images and so on. 

The specification discloses the following matters about the configuration of the 
embodiments described above. 
15 According to one embodiment of the present invention, there is provided an 

image generation method for generating an image comprising: 
storing object data in an object data storage section; 

disposing a plurality of objects in an object space, based on the object data 
stored in the object data storage section; 
20 controlling a virtual camera; and 

generating an image viewed from the virtual camera in the object space while 
performing hidden surface removal processing, 

the method further comprising: 

disposing in the object space a model object including a plurality of part 
25 objects each of which has a projection shape, each of the part objects having a 
projecting portion formed on a display surface on which an image is drawn; and 

rotating each of the part objects based on rotational information of the virtual 

25 



camera so that the display surface of each of the part objects is directed toward the 
virtual camera. 

According to this embodiment, the model object comprises projection-shaped 
part objects each of which has a projecting portion (a vertex and ridgelines) formed on 
5 the side of the display surface (front surface). When the virtual camera rotates, the part 
objects are rotated while the display surfaces (or projecting portions) thereof are 
directed toward the virtual camera. Thus, the image of the display surface of the part 
object will have its maximum area in the view image which is viewed from the virtual 
camera. Consequently, a realistic image can be generated with less primitive faces. 
10 When the virtual camera rotates (or when the orientation of the virtual camera is 
changed), furthermore, the positional relationship between the adjacent part objects (in 
the depth direction) will gradually be inverted. As a result, a more natural image can be 
generated. 

The image generation method may further comprise: 
1 5 storing a Z texture in which an offset value of a Z-value is set on each texel in a 

texture storage section; and 

mapping the Z texture stored in the texture storage section on each of the 
objects, and 

the method may further comprise: 
20 mapping on each of the part objects the Z texture for setting bump shapes on 

the display surface by pixel unit. 

In such a manner, the bump shapes (virtual Z-values) finer than the projecting 
portions inherent in the part objects can be virtually set on the display surfaces of the 
part objects, resulting in representation of a delicately waved intersection boundary line. 
25 According to another embodiment of the present invention, there is provided an 

image generation method for generating an image comprising: 
storing object data in an object data storage section; 
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disposing a plurality of objects in an object space, based on the object data 
stored in the object data storage section; 

storing a Z texture in which an offset value of a Z-value is set on each texel in a 
texture storage section; 

5 mapping the Z texture stored in the texture storage section on each of the 

objects; 

controlling a virtual camera; and 

generating an image viewed from the virtual camera in the object space while 
performing hidden surface removal processing, 
1 0 the method further comprising: 

disposing a model object having a plurality of part objects in the object space; 
rotating each of the part objects based on rotational information of the virtual 
camera so that a display surface of each of the part objects on which an image is drawn 
is directed toward the virtual camera; and 
15 mapping on each of the part objects the Z texture for forming a virtual 

projection shape on the display surface of the part objects. 

According to this embodiment, a part object is rotated so that the display 
surface thereof is directed toward the virtual camera, and at the same time a Z texture 
for setting a virtual projection shape (virtual Z-value) on the display surface of the part 
20 object is mapped on the part object. Thus, the image of the display surface of the part 
object will have its maximum area in the view image which is viewed from the virtual 
camera. Consequently, a realistic image can be generated with less number of primitive 
faces. Moreover, the positional relationship between the adjacent part objects (in the 
depth direction) will gradually be inverted using the virtual Z-values set by the Z texture. 
25 As a result, a more natural image can be generated. 

The image generation method may further comprise: 

disposing a column-shaped part object included in the model object so as to 
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stand along a Y-axis, the Y-axis being an axis along a vertical direction; 

disposing each of the part objects at a position apart from a central axis of the 
column-shaped part object; and 

rotating each of the part objects about the Y-axis so that the display surface of 
5 each of the part objects is directed toward the virtual camera when the virtual camera 
rotates about the Y-axis while being directed toward the column-shaped part object. 

Thus, even if the virtual camera is panned about the Y-axis while being directed 
toward the model object, an image viewed as if the part objects exist over the 
column-shaped part object in all directions can be generated. 
10 The image generation method may further comprise: 

disposing a column-shaped part object included in the model object so as to 
stand along a Y-axis, the Y-axis being an axis along a vertical direction; 

disposing each of the part objects at a position apart from a central axis of the 
column-shaped part object; and 
15 rotating each of the part objects about an X-axis which is perpendicular to the 

Y-axis so that the display surface of each of the part objects is directed toward the 
virtual camera when the virtual camera rotates about the X-axis while being directed 
toward the column-shaped part object. 

Thus, even if the virtual camera is panned about the X-axis while being 
20 directed toward the model object, an image viewed as if the part objects exist over the 
column-shaped part object in all directions can be generated. 

In the image generation method, the part objects may include a first part object 
and a second part object, the first and second part objects being adjacent each other, and 

the method may further comprise: 
25 disposing the first and second part objects so as to overlap each other in a view 

image viewed from the virtual camera or intersect each other even when the virtual 
camera rotates 360 degrees about a given coordinate axis. 
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Thus, even if the virtual camera rotates 360 degrees about a given coordinate 
axis (Y-axis, X-axis or the like), a gap can be prevented from being created between the 
adjacent first and second part objects in the view image viewed from the virtual camera. 
As a result, a more natural and realistic image can be generated. 
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